An axiomatic definition of shannon's entropy
نویسندگان
چکیده
منابع مشابه
Axiomatic Definition of Entropy for Nonequilibrium States
In introductory courses and textbooks on elementary thermodynamics, entropy is often presented as a property defined only for equilibrium states, and its axiomatic definition is almost invariably given in terms of a heat to temperature ratio, the traditional Clausius definition. Teaching thermodynamics to undergraduate and graduate students from all over the globe, we have sensed a need for mor...
متن کاملAn Improved Axiomatic Definition of Information Granulation
To capture the uncertainty of information or knowledge in information systems, various information granulations, also known as knowledge granulations, have been proposed. Recently, several axiomatic definitions of information granulation have been introduced. In this paper, we try to improve these axiomatic definitions and give a universal construction of information granulation by relating inf...
متن کاملAn axiomatic approach to the definition of the entropy of a discrete Choquet capacity
An axiomatization of the concept of entropy of a discrete Choquet capacity is given. It is based on three axioms: the symmetry property, a boundary condition for which the entropy reduces to the classical Shannon entropy, and a generalized version of the well-known recursivity property. This entropy, recently introduced to extend the Shannon entropy to nonadditive measures, fulfills several pro...
متن کاملA Preferred Definition of Conditional Rényi Entropy
The Rényi entropy is a generalization of Shannon entropy to a one-parameter family of entropies. Tsallis entropy too is a generalization of Shannon entropy. The measure for Tsallis entropy is non-logarithmic. After the introduction of Shannon entropy , the conditional Shannon entropy was derived and its properties became known. Also, for Tsallis entropy, the conditional entropy was introduced a...
متن کاملAn axiomatic definition of divergence for intuitionistic fuzzy sets
An axiomatic definition of divergence measure for intuitionistic fuzzy sets (IFSs, for short) is presented in this work, as a particular case of dissimilarity between IFSs. As the concept of divergence measure is more restrictive, it has particular properties which are studied. Furthermore, the relationships among IF-divergences, dissimilarities and distances are studied. We also provide some m...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied Mathematics Letters
سال: 1992
ISSN: 0893-9659
DOI: 10.1016/0893-9659(92)90084-m